Context dependent learning in neural networks

In this paper an extension to the standard error backpropagation learning rule for multi-layer feed forward neural networks is proposed, that enables them to be trained for context dependent information. The context dependent learning is realised by using a different error function (called Average Risk: AVR) in stead of the sum of squared errors (SQE) normally used in error backpropagation and by adapting the update rules. It is shown that for applications where this context dependent information is important, a major improvement in performance is obtained

Analysis of Neural Networks through Base Functions

Problem statement. Despite their success-story, neural networks have one major disadvantage compared to other techniques: the inability to explain comprehensively how a trained neural network reaches its output; neural networks are not only (incorrectly) seen as a "magic tool" but possibly even more as a mysterious "black box" [1]. This is an important aspect of the functionality of any technology, as users will be interested in "how it works" before trusting it completely. Although much research has already been done to "open the box," there is a notable hiatus in known publications on analysis of neural networks. So far, mainly sensitivity analysis and rule extraction methods have been used to analyze neural networks. However, these can only be applied in a limited subset of the problem domains where neural network solutions are encountered

Process identification through modular neural networks and rule extraction

Monolithic neural networks may be trained from measured data to establish knowledge about the process. Unfortunately, this knowledge is not guaranteed to be found and - if at all - hard to extract. Modular neural networks are better suited for this purpose. Domain-ordered by topology, rule extraction is performed module by module. This has all the benefits of a divide-and-conquer method and opens the way to structured design. This paper discusses a next step in this direction by illustrating the potential of base functions to design the neural model. \ud [Full paper published as: Berend Jan van der Zwaag, Kees Slump, and Lambert Spaanenburg. Process identification through modular neural networks and rule extraction. In Proceedings FLINS-2002, Ghent, Belgium, 16-18 Sept. 2002.

Interposing Flash between Disk and DRAM to Save Energy for Streaming Workloads

In computer systems, the storage hierarchy, composed of a disk drive and a DRAM, is responsible for a large portion of the total energy consumed. This work studies the energy merit of interposing flash memory as a streaming buffer between the disk drive and the DRAM. Doing so, we extend the spin-off period of the disk drive and cut down on the DRAM capacity at the cost of (extra) flash.\ud \ud We study two different streaming applications: mobile multimedia players and media servers. Our simulated results show that for light workloads, a system with a flash as a buffer between the disk and the DRAM consumes up to 40% less energy than the same system without a flash buffer. For heavy workloads savings of at least 30% are possible. We also address the wear-out of flash and present a simple solution to extend its lifetime

Molding the Knowledge in Modular Neural Networks

Problem description. The learning of monolithic neural networks becomes harder with growing network size. Likewise the knowledge obtained while learning becomes harder to extract. Such disadvantages are caused by a lack of internal structure, that by its presence would reduce the degrees of freedom in evolving to a training target. A suitable internal structure with respect to modular network construction as well as to nodal discrimination is required. Details on the grouping and selection of nodes can sometimes be concluded from the characteristics of the application area; otherwise a comprehensive search within the solution space is necessary

RoADS: A road pavement monitoring system for anomaly detection using smart phones

Monitoring the road pavement is a challenging task. Authorities spend time and finances to monitor the state and quality of the road pavement. This paper investigate road surface monitoring with smartphones equipped with GPS and inertial sensors: accelerometer and gyroscope. In this study we describe the conducted experiments with data from the time domain, frequency domain and wavelet transformation, and a method to reduce the effects of speed, slopes and drifts from sensor signals. A new audiovisual data labelling technique is proposed. Our system named RoADS, implements wavelet decomposition analysis for signal processing of inertial sensor signals and Support Vector Machine (SVM) for anomaly detection and classification. Using these methods we are able to build a real time multiclass road anomaly detector. We obtained a consistent accuracy of ≈90% on detecting severe anomalies regardless of vehicle type and road location. Local road authorities and communities can benefit from this system to evaluate the state of their road network pavement in real time

Reuse of pervasive system architectures

Developers are often confronted with incompatible systems and lack a proper system abstraction that allows easy integration of various hardware and software components. To try solve these shortcomings, building blocks are identified at different levels of detail in today’s pervasive/communication systems and used in a conceptual reasoning framework allowing easy comparison and combination. The generality of the conceptual framework is validated by decomposing a selection of pervasive systems into models of these building blocks and integrating these models to create improved ones. Additionally, the required properties of pervasive systems on scalability, efficiency, degree of pervasiveness, and maintainability are analysed for a number of application areas. The pervasive systems are compared on these properties. Observations are made, and weak points in the analysed pervasive systems are identified. Furthermore, we provide a set of recommendations as a guideline towards flexible architectures that make pervasive systems usable in a variety of applications

Handwritten digit recognition: a neural network demo

A handwritten digit recognition system was used in a demonstration project to visualize artificial neural networks, in particular Kohonen¿s self-organizing feature map. The purpose of this project was to introduce neural networks through a relatively easy-to-understand application to the general public. This paper describes several techniques used for preprocessing the handwritten digits, as well as a number of ways in which neural networks were used for the recognition task. Whereas the main goal was a purely educational one, a moderate recognition rate of 98% was reached on a test set